A Textual Entailment System using Web based Machine Translation System
نویسندگان
چکیده
The article presents the experiments carried out as part of the participation in Recognizing Inference in Text (NTCIR-9 RITE) @NTCIR9 for Japanese.NTCIR-9 RITE has four subtasks, Binary-class (BC) subtask, Multi-class (MC) subtask, Entrance Exam and NTCIR-9 RITE4QA. We have submitted a total of three unique runs (Run 1, Run 2 and Run 3) in the BC subtask and one run each in the MC Subtask, Entrance Exam subtask and NTCIR-9 RITE4QA subtask. The first system for BC subtask is based on Machine Translation using the web based Bing translator system. The second system for the BC subtask is based on lexical matching. The third system is based on a voting approach on the outcomes of the first and the second system. The system for MC subtask is based on a learned system that uses different lexical similarity features like Word Net based Unigram Matching, Bigram Matching, Trigram Machine, Skip-gram Matching, LCS Matching and Named Entity (NE) Matching. For Entrance Exam and NTCIR-9 RITE4QA subtask, we develop a single system based on the Ngram matching module similar to the second system of the BC subtask. For the BC subtask, the accuracy for Run 1, Run 2 and Run 3 are 0.490, 0.500 and 0.508 respectively. For the MC subtask, the accuracy is 0.175. The accuracy figures of the Entrance Exam subtask and the NTCIR-9 RITE4QA subtask are 0.5204 and 0.5954 respectively.
منابع مشابه
Binary-class and Multi-class based Textual Entailment System
The article presents the experiments carried out as part of the participation in Recognizing Inference in TExt (RITE-2) @NTCIR10 for Japanese. RITE-2 has four subtasks Binary-class (BC) subtask for Japanese and Chinese, Multi-class (MC) subtask for Japanese and Chinese, Entrance Exam for Japanese and RITE4QA for Chinese. We have submitted three runs in BC subtask for Japanese (JA) (one run), Ch...
متن کاملYamraj: Binary-class and Multi-class Based Textual Entailment System for Japanese (JA) and Chinese Simplified (CS)
The article presents the experiments carried out as part of the participation in Recognizing Inference in TExt and Validation (RITE-VAL) 1 at NTCIR-11 for Japanese. RITE-VAL has two subtasks i.e. Fact Validation and System Validation subtask for Chinese-Simplified (CS), ChineseTraditional (CT), English (EN), and Japanese (JA) and semantic relation between two texts such as entailment, contradic...
متن کاملUoW: NLP techniques developed at the University of Wolverhampton for Semantic Similarity and Textual Entailment
This paper presents the system submitted by University of Wolverhampton for SemEval-2014 task 1. We proposed a machine learning approach which is based on features extracted using Typed Dependencies, Paraphrasing, Machine Translation evaluation metrics, Quality Estimation metrics and Corpus Pattern Analysis. Our system performed satisfactorily and obtained 0.711 Pearson correlation for the sema...
متن کاملRecognizing Textual Entailment in Non-english Text via Automatic Translation into English
We show that a task that typically involves rather deep semantic processing of text—being recognizing textual entailment our case study—can be successfully solved without any tools at all specific for the language of the texts on which the task is performed. Instead, we automatically translate the text into English using a standard machine translation system, and then perform all linguistic pro...
متن کاملSemantic Textual Similarity for MT evaluation
This paper describes the system used for our participation in the WMT12 Machine Translation evaluation shared task. We also present a new approach to Machine Translation evaluation based on the recently defined task Semantic Textual Similarity. This problem is addressed using a textual entailment engine entirely based on WordNet semantic features. We described results for the Spanish-English, C...
متن کامل